Assessment  Highlights 

Grade  3 English  Language  Arts 


June  1995 


Student  Evaluation 


Liberia 

EDUCATION 


Assessment  Highlights 

Grade  3 English  Language  Arts 


This  report  provides  teachers,  school  administrators,  and  the  public  with  an  overview  of  the  results  for  the 
June  1995  Grade  3 Language  Arts  provincial  assessment.  It  complements  the  detailed  school  and 
jurisdiction  reports. 


Percentage  of  Students  Meeting: 

Acceptable  Standard 

100  


Writing  Reading  Total 


Writing  Reading  Total 


Achievement  Standards* 

£§§  Actual  Results** 

*the  percentage  of  students  in  the  province 
expected  to  meet  the  acceptable  standard  and 
the  standard  of  excellence 
**the  percentage  of  students  in  the  province  who 
met  the  standards  (based  on  those  who  wrote) 


Who  Wrote  the  Test ? 

All  students  registered  in  Grade  3 were  expected  to  write  the 
1995  English  Language  Arts  Achievement  Test.  A total  of  39 
794  students  wrote  and  were  included  in  reported  results. 
This  number  reflects  an  increase  of  approximately  2 300 
students  over  the  last  administration  of  the  test  in  1993.  In 
1995,  only  a small  proportion  of  students  in  Grade  3 did  not 
write  the  test:  0.7%  of  students  were  absent  and  2.1%  of 
students  were  excused  from  writing  by  their  superintendent, 
and  an  additional  1.9%  of  students  wrote  only  one  part  of  the 
test. 

What  Was  the  Test  Like ? 

The  test  had  two  parts. 

Part  A:  Writing  provided  students  with  a picture  and  a brief 
explanation  as  a prompt  for  their  writing.  Students  chose 
the  format  (narrative,  letter,  or  diary/joumal  entries)  that 
would  allow  them  to  do  their  best  writing.  This  part  of  the 
test  was  scored  in  five  categories:  Content,  Organization, 
Sentence  Structure,  Vocabulary,  and  Conventions.  Content 
and  Organization  were  weighted  to  be  worth  twice  as  much 
as  each  of  the  other  categories. 

Part  B:  Reading  consisted  of  40  multiple-choice  questions 
based  on  reading  selections  from  fiction,  non-fiction,  poetry, 
and  visual  media. 

How  Well  Hid  Students  Do? 

Overall,  not  enough  students  demonstrated  the  expected 
learnings,  as  assessed  by  the  test. 

In  8.7%  of  the  schools,  the  percentage  of  students  meeting 
the  acceptable  standard  was  significantly  above 
expectations  for  the  province.  In  69.5%  of  the  schools,  the 
percentage  of  students  meeting  the  acceptable  standard  was 
not  significantly  different  from  provincial  expectations.  In 
21.8%  of  schools,  the  percentage  of  students  meeting  the 
acceptable  standard  was  significantly  below  provincial 
expectations.  Schools  where  fewer  than  five  students  wrote 
the  Grade  3 test  are  not  included  in  the  calculations. 
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Detailed  provincial  test  results  are  provided  in  school  and  jurisdiction  reports. 


Has  Achievement  Changed  Over  Time ? 

A study  of  changes  in  achievement  was  conducted  as  part  of  the  provincial  assessment.  Results  show  little 
change  in  achievement  in  writing  compared  to  1993.  Results  for  reading  showed  minimal  changes  in 
achievement  from  1993  to  1995. 

Part  A:  Writing 

Test  Blueprint 

The  blueprint  for  Part  A:  Writing  shows  the  reporting  categories  (scoring  guide),  a description  of  the  writing 
assignment,  and  the  standards. 


Reporting  Category 

Description  of  Writing  Assignment 

*Content  (selecting  ideas  and  details  to  achieve  a 
purpose) 

Events  and/or  actions  should  be  plausible  within  the 
context  established  by  the  writer.  The  student 
should  be  able  to  select  appropriate  details  to 
describe  events  and  characters,  and  their  actions. 

The  writing  assignment  follows  a 
picture  and  a writing  prompt  that  will 
be  read  aloud  to  students.  The 
assignment  allows  the  student  to 
select  the  format  that  would  best  fit 
his/her  approach  to  the  prompt. 

^Organization  (organizing  ideas  and  details  into  a 
coherent  whole) 

The  student  should  be  able  to  organize  ideas, 
events,  and  details  in  a coherent  sequence. 

Sentence  Structure  (structuring  sentences 
effectively) 

The  student  should  be  able  to  use  a variety  of 
sentence  types  and  structures  appropriately. 

Vocabulary  (selecting  and  using  words  and 
expressions  correctly  and  effectively) 

The  student  should  be  able  to  use  words  and 
expressions  appropriately  and  effectively. 

Conventions  (using  the  conventions  of  written 
language  correctly  and  effectively) 

The  student  should  be  able  to  communicate  clearly 
by  adhering  to  appropriate  spelling,  punctuation, 
and  capitalization. 

Standards 


The  student’s  achievement  in  each 
reporting  category  will  be  described 
according  to  the  following  standard 
statements: 

Meets  the  standard  of  excellence 

Approaches  the  standard  of  excellence 

Clearly  meets  the  acceptable  standard 

Does  not  clearly  meet  the  acceptable 
standard 

Clearly  below  the  acceptable  standard 
INS  insufficient 


*These  categories  were  weighted  to  be  worth  twice  as  much  as  each  of  the  others. 
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Observations  and  Results 

Although  the  overall  quality  of  the  writing  in  English  Language  Arts  in  1995  is  quite  comparable  to  that 
done  in  1993,  not  enough  students  are  meeting  provincial  standards.  Many  papers  written  this  year  were 
longer  than  those  done  in  the  past;  however,  quantity  is  not  indicative  of  quality. 

Teacher  markers  generally  found  that  students  were  willing  to  take  risks  with  their  writing.  This  resulted 
in  fewer  papers  that  were  left  blank  or  had  too  little  writing  to  mark.  Many  students  had  difficulty  isolating 
significant  and/or  interesting  details  from  superfluous  information. 

A small  number  of  students  wrote  superior  papers.  These  were  lively,  imaginative,  and  technically  very  well 
written.  The  quality  of  these  papers  far  exceeded  the  expectations  for  students  at  the  Grade  3 level. 


Part  B:  Reading 

Test  Blueprint 

The  blueprint  for  Part  B:  Reading  shows  the  reporting  categories  and  language  function  under  which 
questions  are  classified. 


Question  Distribution  by 
Language  Function 

Number 
of  Questions 

Reporting  Category 

Informational 

Narrative/Poetic 

L Main  Ideas/Details 

The  student  should  be  able  to  identify  key 
details  and  main  ideas,  differentiate 
between  main  and  supporting  characters, 
recognize  character  motivation  and  explicit 
relationships  between  events  and 
characters,  and  categorize  ideas. 

6,  9, 11,  22,  24,  37 

2,  3,  4,  5,  13,  15,  18, 
20,  28,  29,  30,  35 

18 

2.  Organization  of  Ideas  and 

Relationships  between  Form  and 
Content 

The  student  should  be  able  to  identify  genre 
(stories,  poetry,  plays,  reports,  and  articles), 
organize  features  of  story  structure,  use 
text  and  typographical  features,  recognize 
author’s  techniques,  and  determine  an 
author’s  purpose. 

8,  40 

14,  16,  27,  32,  36 

7 

3.  Associating  Meaning 

The  student  should  be  able  to  associate 
meanings  of  words,  expressions,  and 
literary  devices  from  prior  knowledge  and 
contextual  clues. 

10 

1,  19,  33,  34 

5 

4 Synthesizing  Ideas 

The  student  should  be  able  to  draw 
conclusions  by  relating  what  is  known  to 
new  information,  and  assess  the 
plausibility  of  ideas  and  situations  in 
literature. 

7, 12,  23,  25,  26,  38, 
39 

17,  21,  31 

10 

Number  of  Questions 

16 

24 

40 
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Observations  and  Sample  Questions 

The  following  is  a discussion  of  specific  areas  of  strength  and  weakness  for  students  in  Grade  3 classrooms. 
Sample  questions  from  the  test  are  provided  to  highlight  these  areas  for  students  meeting  the  acceptable 
standard  and  for  those  meeting  the  standard  of  excellence.  For  each  sample  question,  the  keyed  answer  is 
marked  with  an  asterisk.  These  questions  are  no  longer  secured  and  will  not  be  reused  in  1996. 


3.  Mr.  Little  made  a small  red  cap  for  Stuart  because  it  would 

O be  his  favorite  colour 
O make  him  feel  like  a hunter 
* O be  easier  to  see  him 
O keep  his  head  warm 


For  question  4,  students  were  required  to 
determine  the  explicit  relationship  between 
the  character*  and  events.  A little  over 
80r/i  of  student*  who  met  the  acceptable 
standard  were  able  to  do  this.  This 
question  posed  more  difficulty  for  these 
students 


16.  The  author  of  this  story  is  For  qu«**tion  16,  students  were  required  to 

use  text  features  to  assist  them  in 

° identify, np  thr  author.  Over  65%  of 

O the  dog 

O fables  student*  who  met  the  acceptable  standard 

*0  Aesop  were  able  to  do  this.  Of  the  three  sample 

question*,  this  was  clearly  a more 
challenging  question  for  students  meeting 
the  acceptable  standard. 

The  strengths  of  students  who  met  the 
acceptable  standard  include  the  ability  to 

• make  generalizations  about  characters 
and/or  their  motivations 

• recognize  relationships  between 
characters  and  events 

• locate  key  details 

• relate  what  is  known  to  new  information 

• differentiate  between  major  and  minor 
characters 

• use  visual  clues  with  text  to  get  meaning 

However,  many  students  did  not  do  as  well 
as  expected  in 

• using  contextual  clues  to  determine 
meanings 

• using  contextual  clues  to  describe 
character  motivation 


4.  The  refrigerator  door  was  open  because  Mrs.  Little 

* O needed  something  in  the  refrigerator 
O was  looking  for  Stuart 

O was  feeling  hungry 

O forgot  to  close  it 


Acceptable  Standard 
For  question  3,  students  were  required  to 
identify  key  details  in  order  to  judge 
character  motivation.  About  92%  of 
student* *  who  met  the  acceptable  standard 
were  able  to  do  this,  indicating  that  it  was 
quite  a simple  task  for  them. 
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• identifying  main  ideas 

• using  text  features 

• using  prior  experience  or  knowledge  to 
draw  conclusions 

• recognize  genre 

Standard  of  Excellence 

1.  What  is  the  meaning  of  the  underlined  word  seldom?  For  question  1,  students  were  required  to 

use  context  clues  to  recognize  a word 
meaning.  About  67%  of  the  students  who 
met  the  standard  of  excellence  were  able  to 
do  this. 


For  question  6,  students  were  required  to 
make  a judgement  by  identifying  key 
details.  A little  over  82%  of  the  students 
who  met  the  standard  of  excellence  were 
able  to  do  this. 

Sample  question  1 was  clearly  more 
challenging  for  students  meeting  the 
standard  of  excellence  than  sample 
question  6. 


Overall,  students  who  met  the  standard  of 
excellence  had  few  difficulties  with  this 
assessment.  These  students  show 
strengths  in 

• synthesizing  information  (making 
judgements  and  drawing  conclusions) 

• using  contextual  clues  to  recognize 
meanings  of  words  and  phrases 

• understanding  author’s  purpose 

• making  judgements  about  character 
motivation. 

Comments 

Student  Collaboration  Time  Before  Writing 

Teachers  indicated  that  they  appreciated  that  students  were  allowed  to  talk  to  each  other  before  the  actual 
planning  of  their  stories.  They  felt  that  this  was  more  reflective  of  the  way  children  actually  prepare  to 
write  in  their  classrooms.  Many  teachers  indicated  that  they  would  like  more  teacher-directed  planning. 
Even  though  this  practice  is  appropriate  and  desirable  in  the  context  of  the  classroom,  it  is  not  feasible  in  a 
large-scale  assessment,  where  it  is  vital  that  consistency  in  administration  be  maintained. 

Planning  Sheets 

Markers  indicated  that  directions  needed  to  be  made  clearer  to  the  students  and  teachers  to  do  the  planning 
on  the  planning  sheet  provided  in  the  writing  booklet,  and  not  to  use  a ready-made  plan  sheet.  For  1996,  the 
direction  to  plan  on  the  planning  sheet  will  be  more  clearly  stated. 


6.  In  yogurt  popsicles,  the  MAIN  ingredients  are 

O orange  juice  and  a large  mixing  bowl 
O yogurt  and  a freezer 

* O yogurt  and  orange  juice 

O popsicle  sticks  and  paper  cups 


O Many  times 
O Often 
O Never 
* O Hardly  ever 
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Local  Marking 

Also  for  the  first  time  this  year,  teachers  were  allowed  to  mark  their  own  students’  papers  before  returning 
them  for  central  marking.  Initial  results  are  very  encouraging.  Approximately  25%  of  the  papers  were 
marked  locally  and  scores  submitted  to  Alberta  Education.  A high  level  of  reliability  was  achieved  for  these 
papers.  Papers  found  to  be  discrepant  between  first  and  second  readings  were  given  a third  adjudicating 
read.  The  third  reading  rescore  rate  was  less  than  8%.  As  more  teachers  have  the  opportunity  to  become 
familiar  with  the  provincial  scoring  criteria  and  standards,  we  expect  that  the  number  of  teachers  marking 
locally  will  increase. 

Resolving  Administration  Anomalies 

Although  we  announced  the  new  practice  of  reusing  items  from  1992,  1993,  or  1994  tests,  and  the  securing  of 
these  tests  as  late  as  October  1994,  most  schools  were  able  to  respond  quickly  and  were  successful  in 
avoiding  the  use  of  these  tests  with  students.  Consequently,  the  1995  testing  was  conducted  effectively 
throughout  Alberta  without  compromising  the  validity  of  the  results.  In  a few  schools,  however,  questions 
were  raised  about  students’  prior  access  to  the  test  items  and  concerns  were  rightfully  expressed  about 
fairness  and  accuracy.  Superintendents  were  asked  to  investigate,  along  with  school  principals  and 
teachers,  these  and  all  other  non-standard  testing  practices  brought  to  our  attention  and  to  make 
recommendations  about  the  validity  of  results.  Initially,  765  student  results  for  Grade  3 Language  Arts 
were  reported  as  “not  available,”  pending  further  investigation  due  to  validity  concerns.  In  the  end,  results 
for  only  74  students  were  determined  to  be  invalid  for  Grade  3 Language  Arts. 

Release  of  Secured  Items 

As  outlined  in  the  General  Information  Bulletin,  items  from  the  achievement  tests  are  secured  except  those 
that  are  released  each  year  in  the  subject  area  bulletins.  The  items  in  these  bulletins  may  be  used  to 
prepare  students  for  the  provincial  assessment.  The  subject  area  bulletins  are  mailed  to  all  schools  in  the 
fab. 

Parent  Guide  to  Provincial  Achievement  Testing 

Last  spring,  we  sent  to  schools  copies  of  the  Parent  Guide  to  Provincial  Achievement  Testing  to  distribute  to 
parents  through  the  students  in  grades  3,  6,  and  9.  The  purpose  was  to  support  open  communication  about 
provincial  standards  and  the  testing  program  among  the  teacher,  the  student,  and  the  parent.  The  guide 
included  a tear-out  card  with  several  questions  and  space  for  comments.  Parents  returned  over  2000  cards; 
about  half  included  comments.  Parents’  feedback  about  the  learnings  expected  of  students,  the  quality  of 
questions  on  the  tests,  and  the  testing  program  was  generally  positive.  Their  written  comments  ranged  from 
positive  to  negative,  and  many  simply  asked  for  more  information.  As  parents  seemed  to  appreciate  this 
form  of  communication,  we  are  looking  for  a way  to  make  the  guide  available  again  later  this  school  year. 

Performance-Based  Assessment 

In  addition  to  the  Achievement  Test,  a random  sample  of  students  from  across  the  province  participated  in 
performance-based  assessments  in  Language  Arts  3 , Mathematics  6 , and  Social  Studies  9. 

Performance-based  assessment  reports  will  be  sent  to  participating  schools.  A “Samples  of  Student 
Responses ” document  for  the  performance-based  assessment  will  be  prepared  and  made  available  to  all 
schools  in  the  spring  of  1996. 
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1995  Administration — A Note  of  Thanks 


National  Library  of  Canada 
Bibliothdque  nationale  du  Canada 


3 3286  50807  7225 


We  at  Student  Evaluation  wish  to  express  our  appreciation  to  you,  the  principals  and  teachers  throughout 
Alberta,  for  the  care  and  attention  you  gave  to  the  administration  of  the  1995  achievement  tests.  Successful 
implementation  of  the  expanded  program  and  the  changes  in  procedures  and  rules  depended  on  your 
assistance  and  cooperation.  We  hope  that  you  find  the  changes  in  the  testing  and  the  additional  achievement 
information  helpful  in  your  work  with  students. 


For  further  information,  contact  Phyllis  Kozak,  Grade  3 Assessment  Specialist,  or  Dennis  Belyk,  Assistant 
Director,  at  403-427-0010.  The  toll-free  number  is  310-0000. 


Printed  November  1995 
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